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HE LITERATURE on reasoning reveals 
‘Ta variety of methods used or usable 
by subjects during problem-solving. Al- 
though some of the methods are reported 
as having been experimentally observed 
in psychological studies, other methods 
appear to be personal reflections on how 
problems could be solved. Whereas the 
former could actually be either effica- 
cious, indifferent, or detrimental to 
successful solution, the latter are im- 
plicitly presumed to be advantageous. 
Nine of these “methods of attack” have 
been selected for investigation in this 
experiment, in an attempt to determine 
their use and efficacy for a variety of 
problems. 

There are three questions with which 
we shall deal: 

1. How do individuals differ in the 
methods they use to solve problems? 

2. To what extent are these methods 
used in solving problems? 

3. To what extent are different meth- 
ods efficacious?, 

The nine methods selected for investi- 
gation are described below. 

1. Clear formulation of the problem. 
Dewey early emphasized the importance 
of awareness of the specific problem. In 
his first edition of How We Think, he 
discussed as the first 2 of his 5 steps in 
reflective thinking: (a) a felt difficulty, 
and (b) its location and definition. 

2. Preliminary survey of all aspects of 
the presented material. The Gestalt 
School has stressed the role of survey of 
the whole field—the situation as a whole. 


* In accordance with new editorial policy, the 
review of the literature on reasoning, forming 
the background of this inquiry, is omitted in 
this monograph, but is a part of the original 
dissertation, available on interlibrary loan from 


the Northwestern University Library, Evanston, 
Illinois, 


I. STATEMENT OF THE PROBLEM* 


And Durkin (6) found that solution was 
facilitated by initial familiarity with all 
the parts of her construction-puzzles. 

3. Analysis into major variables. Sea- 
shore (17, p. 554) writes, “In any large 
and dificult problem, one of the first 
steps is to analyze out its main variables, 
which may then be attacked one at a 
time, in simpler fashion.” Here the 
problem-solver might ask himself this 
question: “What are the principal fac- 
tors which determine or influence the 
solution of this problem?” It is recog- 
nized that the problem-solver may utilize 
variables not helpful for solution, 

4. Locating a crucial aspect of the 
problem: “Loci” (Ruger), “Direction” 
(Maier), “Analysis” (Heidbreder). The 
subject might question: “What part of 
the problem seems to merit special atten- 
tion as the central factor relative to solu- 
tion?” Ruger found his subjects becom- 
ing aware of the “locus” of difficulty. 
Maier demonstrated the importance of 
the “way the problem is attacked.” How- 
ever, Maier also warns against “habitual 
behavior” or “persistence” as false direc- 
tion, wrong attack, a side-track away 
from correct direction leading to solu- 
tion. And Heidbreder suggested that the 
function of analysis is to reduce the sup- 
ply of stimulus-content by singling out 
possibly-significant features. As with 
major variables, the problem-solver may 
pursue aspects “crucial” to him, but 
actually not helpful to solution. 

5. Application of past experience. 
The significance of applying past ex- 
perience (“transfer”) is a commonplace 
(Barlow, Chant, Kinnamon, Lindworsky, 
Lyon). Drever (5) concluded that the 
application is not necessarily conscious. 
6. Varied trials. By definition, repeti- 
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tion of the same kind of trial could not 
be successful unless it was correct the first 
time (also note the previously mentioned 
warning of Maier against persistence in 
an unsuccessful direction). Variability 
has been established as one of the prime 
factors conducive to solution (Bain, 
Durkin, Lloyd Morgan, Thorndike, J. C. 
Peterson, et all.). 

7. Control. In experimentation, con- 
trol (variation, isolation, repetition) is 
foundational. In solving a problem, the 
question can be put: “How can I control 
each factor involved so as to determine 
its effect and relative influence?” 

8. Elimination of sources of error. The 
literature reveals scarce mention of the 
role of this factor. What sources of error 
(for instance, unsteadiness in a delicate 
mechanical puzzle) may be eliminated or 
controlled so as to facilitate solution of 
the problem? As with other methods (see 
3 and 4, above), the problem-solver may 
eliminate factors which are not actually 
sources of error. 

g. Visualization. Chen, Comstock, 
Eidens, Pear, Storring, Wilhelm, and 
many others have demonstrated the role 
of imagery in reflective thinking. In be- 
havioristic terms imagery may be con- 
sidered as the use of implicit trials. 


Even at the outset, it appeared that 
some overlapping exists among certain 
of these methods, for example “analysis 
into major variables” and “locating a 
crucial aspect of the problem.” 

The subjects were 25 students en- 
rolled in an advanced undergraduate 
course in psychology. It was recognized 
that any conclusions concerning efficacy, 
and especially extent of use, of specific 
methods would be based on a highly 
select group of subjects, and that the ex- 
periment should be considered only as 
an exploratory study opening the way to 
systematic study of problem-solving in 
the general population. 

Three problems were chosen, not as 
representative of typical human prob- 
lems, but because their simplicity would 
permit some objective analysis relatively 
uncomplicated by the non-intellectual 
(e.g., emotional) factors often affecting 
daily problem-solving. The three prob- 
lems, involving induction, deduction, 
and geometrical-figure analysis, are de- 
scribed in the next section. 

Our problem, then, was to determine 
the use and efficacy of nine known 
“methods of attack” on different prob- 
lems. 


II. THE PROBLEM-MATERIALS 


A. THE INDUCTION PROBLEM 
1. Construction 


HE INDUCTIVE PROBLEM, largely concept-formation (devised by Professor Thur- 
Tein is presented in full, below. Five groups of letters are presented, with four 
groups always containing something in common; the subject is to detect the group 
not containing the feature common to the other four groups. Exclusive of the prac- 
tice-problems, 19 such problems were given. 


LETTER-GROUPING 
In the five groups of letters below, notice that four of the groups have something in common. 
The one which is not like the other has been marked. 


YLNPJ XBPZR YNTFH YRGSW . YHDLY 


Four of the groups begin with the letter Y. The one which does not begin with Y is marked. 
Look at the next problem. 


AAXVP FNTBB HQTQX JDSWR MECTE 


Four of the groups have a repeated letter. The first, second, third, and fifth groups have the letters 
AA, BB, QQ, and EE respectively. The fourth group does not have a repeated letter. It is unlike 
the other groups so it is marked. 
Work the next two problems, Put a mark under the group which is different in each case. 
ABCDE XYZPS EFGHI CXVTN PJKLM 
EDCBA VWXYZ IHGFE JKLMN SBTGK 


In the first problem four of the groups have letters occurring in alphabetical order. You should 
have put a mark under the fourth group. 
In the second problem four of the groups are in alphabetical order, left to right or right to left. 
The fifth group should be marked. 
Look at the next two problems, Try to find which one should be marked. 
BDHQX SDAPZ GXMOT LEZTQ NXUFS 
KCUPE FZEGO UMBXA APIQT LNUKH 
In the first problem four of the groups each contain a vowel. The first group should be marked. 
In the second problem four of the groups have two vowels. Group five should have been marked. 
Now work the next two problems. In each case put a mark under the group which is different. 
jPIDX KPHMA LPZSU MPLJE NPRWO 
PZDDD SSSPB JPPPN HNNNX BQBFB 
In the first problem four of the groups have the vowel in the last place. The first group should 
be marked. 
In each group of the second problem there is a letter occurring three times. In four of the groups 
the three identical letters are together. The last group should be marked. 


Work the problems which follow. 


1. VBCDF WQRSH XIJKF YLMNF ZABCF 
2. ELMNE FABCF GOPQG HZTMH IVWXI 
3. LGBGM TBKAK ZDNEN FRLLC VPSPW 
4. XVTQZ BFDHJ HDFBJ ]BFDH HJFBD 
5. BCAHV BCOHV DZELM DKILM DTCLM 
6. FCRCT CJCCL CPCSC CCRCQ CKCFC 
7. BWBRB BBCBS RBMBB BNBBV XBBZB 
8. BQHTM AUIEO ZDKRN TMPZB HXKQN 
9. EFGHI EDCBA UTSRQ ALRXI OPQRS 
10. CEDGH FAGHB DKCES LMCED MPCEK 
11, CFAGG PESRP VROVF NOMSN PROTS 
12, ONMLK LKJIH UTSRQ GKMOQ HGFED 
13. ALMNA PBCDP EVRHE UJKLU IDVLI 
14. CCPPR MSSMR TRRTR JNNJR WWDDR 
15. BSQVM TDPDX GHGRG FPSFR MPMBM 
16. ACTRM ABSPQ CDTGH PQBXY MNCST 
17. JKLMV BPQRS KNWXY BCDQT CXTRF 
i8. FGHLM CDFGH JKMNO STVWX PQSTU 


ig. VMSAT DGMSB SPLOM QTMSC MSDHP 
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2. Administration 


This group of problems was adminis- 
tered individually to 20 of the 25 sub- 
jects (5 students reported familiarity 
with this induction-test; their results 
were excluded). As per directions on the 
form, the subject first worked all of the 
practice-problems. Starting with the last 
set of (five) practice-problems, the subject 
was questioned, as soon as he finished 
each one, as to why he had selected the 
one group of letters which he had 
marked. His answer was recorded as 
either “correct,” or in full if he had 
marked the right group but gave an in- 
correct reason or if he had marked the 
wrong group and gave some reason for so 
doing. After he was finished, the follow- 
ing four questions were asked so as to 
detect evidence of use of methods of 
attack: 

1. What are you supposed to do in 
these problems? (To detect “Clear formu- 
lation of the problem.”) 

2. Try to list all the ways you can re- 
member in which four groups had some- 
thing in common lacking in the fifth 
group. (To detect “Analysis into major 
variables.”’) 

3. Have you ever had any previous ex- 
perience with a similar kind of problem? 
(If yes:) Were you able to apply this past 
experience here? How? (To detect “Ap- 
plication of past experience.”’) 

4. Do you remember anything else con- 
cerning the procedure you used which 
you believe was helpful in solving these 
problems? (To detect any other methods 
of attack.) 

Since the three specific questions (ex- 
clusive of the last general question) 
tested for only three methods, we relied 
upon careful examination of the sub- 
ject’s worksheet to detect evidence of 
other methods used. It was also recog- 


nized that each question was only one 
way of testing for use of any particular 
method of attack, that subjects unable to 
state use of a method may use the meth- 
od, perhaps unconsciously, and that 
other questions and ways of detecting a 
specific method could be devised; these 
limitations are discussed below, under 
“Discussion” and “Summary and Con- 
clusions.” As with the other problems ad- 
ministered, the subject was allowed as 
much time as he wished for these induc- 
tion-problems. 


B. THe DepuctTion PROBLEM 


1. Construction 


The deductive problem (selected as 
one of 15 items in one of Professor 
Thurstone’s Deductive Reasoning Tests) 
was presented in printed form, as fol- 
lows: 


(a) Captain Watts and his son James have been 
found shot—the father in the chest and the son 
in the back. (b) Both clearly died instantaneously. 
(c) A gun fired close to the person—as, for 
example, when a man _ shoots himself—will 
blacken and even burn the skin or clothes; fired 
from a greater distance it will leave no such 
mark. (d) The two bodies were found near the 
middle of a large hall used as a rifle range. (e) 
Its floor is covered with damp sand which shows 
every footprint distinctly. (f) Inside the room 
there are two pairs of footprints only. (g) A third 
man standing just outside the door or window 
could aim at any part of the room, but the pave- 
ment outside would show no footmarks. (h) 
Under Captain Watts’ body was found a gun; 
no such weapon was found near James. (i) In each 
case the coat, where the bullet entered, was 
blackened with gunpowder, and the cloth a little 
singed. (j) Captain Watts was devoted to his son 
and would have died sooaer than harm him 
purposely; hence it is impossible to suppose that 
he killed him deliberately, even in self-defense. 
(k) But some think that James secretly disliked 
his father and hoped to inherit his fortune at his 
death. 


a. To what was Captain Watts’ death due? 
Murder? Accident? Suicide? 


b. To what was James’ death due? Murder? Ac: 
cident? Suicide? 


2. Administration 


This problem was administered indi- 
vidually to all 25 students. Then the fol- 
lowing questions were asked: 

1. After reading the problem-questions 
at the end of the story, did you re-read 
the entire paragraph, keeping in mind 
constantly the three possibilities of 
murder, accident, suicide? (Since it early 
became evident that all subjects under- 
stood the problem set to them here, we 
used this question as probing for the 
possibility of extreme fixation of the 
answer-possibilities, or extremely vivid 
“Formulation of the problem.”) 

2. How many times did you read the 
whole paragraph? (To detect careful 
“Preliminary survey of all aspects of the 
presented material.’’) 

3- Did you conclude that certain bits 
of given information were important or 
relevant, either directly or indirectly, for 
solving this problem? If so, consult the 
paragraph, and list all such points. (To 
detect “Locating a crucial aspect of the 
problem.”) 

4. Have you ever had any previous 
experience with a similar kind of prob- 
lem? If so, were you able to apply this 
past experience here? How? (To detect 
“Application of past experience.’’) 

5. Did you try to apply the possibility 
of each of the three causes—murder, acci- 
dent, suicide—to the death of Captain 
Watts—and then to the death of James— 
to determine whether the cause could 
have been murder, could have been acci- 
dent, could have been suicide? (To de- 
tect “Varied trials.”’) 

6. If you re-read the paragraph, did 
you single out each sentence to try to 
determine whether any of the various 
sentences made impossible one or two of 
the three possible causes? (To detect 
“Control.”) 
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7. Consult the paragraph for the fol- 
lowing questions: 

a. Was there any information in the 
paragraph which makes the following 
sentence not helpful in solving the 
deaths: “A third man standing just out- 
side the door or window could aim at 
any part of the room but the pavement 
outside would show no footmarks.” 

b. Was there any information which 
indicated whether Captain Watts or 
James died first? 

c. Was there any information which 
made murder improbable for James’ 
death? 

d. Was there any information which 
made suicide improbable for James’ 
death? (To detect “Elimination of 
sources of error.”’) 

8. Did you find yourself visualizing the 
various persons and events? (To detect 
“Visualization.”) 

9. Do you remember anything else 
concerning the procedure you used? (To 
detect any other methods of attack.) 


C. THe GEOMETRICAL-FIGURE PROBLEM 


1. Construction 


The geometrical-figure problem (sug- 
gested by Lindley’s (10) study) is pre- 
sented in Figure 1. As with many other 
similar figure-problems, this figure is to 
be drawn without going over any line 
already drawn and without taking the 
pencil off the paper. Starting at any 
point except either of the two inner 
diagonal points makes solution im- 
possible. Fourteen trials were possible on 
the sheet. 


2. Administration 


This problem was administered indi- 
vidually to 24 of the 25 students (one 
subject accidentally started at the correct 
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starting-point; his paper was excluded). 
The subject was allowed 14 trials. If he 
solved the puzzle on or before the four- 
teenth trial, he was asked to continue, 
and was stopped after making 3 successes 
in a row. The experimenter kept a rec- 
ord of the starting and finishing points 
for each trial. Then the following ques- 
tions were asked: 

1. Did you assume at the outset that 
the directiors required that you start at 
some specific corner? (Since pre-experi- 
mental investigation had revealed that 
many subjects started at the upper left- 
hand corner, we included this question 
to detect any invalid “Formulation of the 
problem.’’) 

2. Before beginning the puzzle, did 
you make a preliminary survey of all 
aspects of the pictured puzzle, or did you 
start drawing after a glance at the 
puzzle? (To detect “Preliminary survey 
of all aspects of presented material.’’) 

3. Did you conclude at any time that 
some special part of the puzzle was best 


to start at? If so, what part? (To detect 
“Locating a crucial aspect of the prob- 
lem.”’) 

4. Have you ever had any previous ex- 
perience with a similar kind of problem? 
If so, were you able to apply this past 
experience here? How? (To detect “Ap- 
plication of past experience.”’) 

5. Did you discover certain moves 
which made solution impossible, or 
moves which you decided to avoid? If so, 
what moves or combination of moves? 
(To detect “Elimination of sources of 
error.’’) 

6. Did you ever visualize the various 
possible next-moves before even tracing 
out these moves on the paper? If so, 
about how many moves ahead did you 
visualize on the average? (To detect 
“Visualization.”’) 

7. Do you remember anything else 
concerning the procedure you used 
which you believe was helpful in solving 
this puzzle? (To detect any other meth- 
ods used.) 


ECAUSE it would break continuity to 

list the findings on extent of use for 
each of three problems and then have to 
return to the problems for data on 
efficacy, we present here the complete 
results for each of the three problems, In 
the “Discussion” of this paper, we shall 
return to our two main questions: use 
and efficacy of various methods of 
attack. 


A. THE INDUCTION PROBLEM 


Table 1 shows the distribution of 
scores. The range is small probably be- 


TABLE 1 

No. of 

Scores Subjects 
N=20 

Mean mI7.15 


cause the items, selected from a speed- 
test, were taken in unlimited time and 
were solved, in most cases, by almost all 
the subjects. 


1. The Methods of Attack Used 


As contrasted with the other two prob- 
lems to be discussed, the induction prob- 
lem revealed only three distinct methods 
of attack. 

(a) Clear formulation of the problem. 
The initial instructions read: “In the 
five groups of letters below, notice that 
four of the groups have something in 
common. The one which is not like the 
others has been marked. 
YLNPJ XBPZR 


Ill. RESULTS 


YNTFH 


Four of the groups begin with the letter 
Y. The one which does not begin with 
Y is marked.” 

The other examples given (8 alto- 
gether) were similar. For each problem, 
four of the five groups have something 
in common lacking in the remaining 
group. It must be noted that the fifth 
group must be not merely different, but 
different in the sense of lacking a char- 
acteristic common to the other groups; 
each group was probably different from 
the other four in the sense of containing, 
say, some letter absent from the other 
four groups, but this kind of difference 
was not the required kind. The failure 
to make the distinction between merely 
being different and being different in the 
sense of lacking a characteristic common 
to four groups became evident in the re- 
sults. A majority of the subjects formu- 
lated the problem simply as: Find the 
group which is different. We have con- 
sidered this as an “incomplete” formula- 
tion. 

Only 40% of the subjects correctly 
formulated the problem, verbally. How- 
ever, incomplete verbal formulation did 
not seem to involve actual incomplete 
formulation during the working of the 
problems, as can be observed by the fact 
that even the lowest score was: 14 correct 
out of a possible 19, or 74% correct 
(chance, for 5 choices, would permit 20% 
correct); it seems axiomatic that success- 
ful solution of this kind of problem 
would require understanding the task. 
Apparently the nature of the task was 
evident in spite of the incomplete verbal 
formulation. This difficulty of mistaking 
inability to state a method for failure to 
detect or use a method was anticipated 
YRGSW YHDLY 
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(see Administration of the Induction 
Problem, above), and continued to ob- 
scure the use of methods in all three 
problems, as further described in this 
paper. Incomplete formulation led, how- 
ever (in a few cases), to the kind of error 
which might be expected: selecting a 
group which was merely different. The 
three examples found are given below: 


SUBJECT RLD: BCAHV BCOHV 


The subject’s reason: “The others do not have 
a letter Z.” Note that to carry out his incorrect 
formulation of the problem at this point the 
subject would be obliged to mark the first group 
as alone containing an A, the second group as 
alone containing an O, the fourth group as alone 
containing a K, and the last group as alone 
containing a T. Selecting the third group be- 
cause it alone contained the letter Z indicates 
incomplete (if not incorrect) formulation. This 
subject’s verbal formulation was: “Pick the one 
group that is different from the other four 


groups.” 


SUBJECT MN: CCPPR MSSMR 

Although the group marked is the correct one, 
the subject’s reason is wrong, close however to 
borderline correctness: “This group has the same 
letter three times.” The correct reason is: The 
other four groups each have one and only one 
letter R, or (another reason): The other four 
groups each have three different letters. This 
subject’s verbal formulation was: “To find the 
group which is different.” 


SUBJECT MEM: BSQVM 

The subject's ‘reason: “The other four groups 
do not have any letter repeated three times.” 
As a matter of fact her statement is false, for 
the third group has the letter G three times. 
But even if her statement were true, her reason 
indicates the same reversal of the problem-task: 
she finds a characteristic absent from four groups 
when the instructions require her to find a 
characteristic present in four groups. Her verbal 
formulation was: “Underline the one that is 
different in any respect from the other four 
groups.” 


(b) Preliminary survey of all aspects 
of the presented material. The particular 


nature of this problem required every 
subject to survey all 5 groups of letters; 


this factor was found in 100% of the 
subjects. 

(c) Analysis into major variables. Our 
question asked the subject to list all the 
ways in which four groups had some- 
thing in common lacking in the fifth 
group. Analysis of all the problems (8 
practice-problems and 19 test-problems) 


DZELM DKILM DTCLM 


gave the following list as including every 
possible reason for the 27 problems that 
each subject encountered: 


Four groups have some common letter (or 2, 
3, 4, Or 5 letters). 

Four groups have only one of a letter common 
to all five groups. 

Four groups have 2 given letters adjacent. 

Four groups have some common letter in a 
constant position (say, fourth in the group 
of letters). 


TDPDX 


TRRTR JNNJR WWDDR 
Four groups have some vowel (or 2 vowels). 
Four groups have some vowel in a constant 

position. 

Four groups have five consonants. 

Four groups have three different letters. 

Four groups have a repeated letter 
letter three times). 


(or a 


GHGRG FPSFR MPMBM 


Four groups have a repeated letter adjacent 
(or separated). 

Four groups have a repeated letter separated 
by one letter. 

Four groups have an alphabetical sequence 
(of 2, 3, 4, or 5 letters). 

Four groups have 2 alphabetical sequences of 
2 and g letters, respectively. 


Analysis of these thirteen ways in 
which four groups had something in 
common further revealed 8 major vari- 
ables basic to all such problems: 

Letters. 

Vowels. 

Consonants. 


Position of a letter. 

Alphabetical sequence. 

Adjacency or separation of 2 given let- 
ters. 

Quantity of a given letter. 

Quantity of different letters within a 
group. 

We credited a subject for each such 
variable stated or indicated in his list of 
“ways in which four groups had some- 
thing in common.” 

Each of the 8 variables was acknowl- 
edged by one or more subjects. Some 
subjects were more thorough in formu- 
lating a variable; for example, some re- 
membered and stated that alphabetical 
sequence could be either forward or 
backward. 

The distribution of the number of 
major variables reported is shown in 
Table 2. 

Although other methods of attack may 
have been employed by the subjects, no 
other methods revealed themselves as 
having been used on this problem. Ex- 
perience with this problem leads us to 
suggest the following reasons for the fact 
that only three methods appeared for 
this problem: 

1. Locating a crucial aspect of the 
problem: Here, it seems (to the writer) 
that this particular problem does not 
contain a “crucial aspect” (further ex- 
plained in the “Discussion’’). 

2. Application of past experience: 


TABLE 2 
Variables Number of 
eported Subjects 

N=20 

Mean = 5.6 variables 


Stand. Dev.= .97 
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The 20 subjects had reported, before the 
experiment, that they had not previously 
worked problems of this kind. 

3. Varied trials: Variation could mean 
several things in this problem. (a) If it 
be considered as referring to the subject’s 
questioning each group’s lack of a char- 
acteristic common to the other four 
groups, then the small amount of stimu- 
lus-material probably permitted every 
subject to try all five groups, time being 
unlimited. (b) If variation be considered 
as referring to trying various generaliza- 
tions (of characteristics possibly com- 
mon to four of the five groups), then 
this “method” becomes synonymous with 
“Analysis into major variables,” 
ported, above, for this problem. 

4. Control: Same as for “Varied trials.” 

5. Elimination of sources of error: As 
with (1) above, the writer doubts that 
this factor is adequately meaningful for 
this problem. 

6. Visualization: The stimulus-material 
itself is visual in nature. 

The full implications of the apparent 
absence of certain methods on certain 
problems will be more completely treated 
in the“Discussion.” 

The range of the total number of 
methods used per subject was from two 
to three, with the mean at 2.4 methods 
per subject. 

A question of special interest was: 
Why did our subjects make the various 
errors we found on their work-records? 
We have analyzed the 19 errors made, in 
relation to the reasons the subjects gave 
in each case for marking the group of 
letters they selected: 


Errors 
Perceptual (visual) errors: 12 (63%) 
Wrongly formulated problem-task: 3 (16%) 
Miscellaneous (hunches, etc): 4 (21%) 
Total: 19 
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VBCDF WQRSH 


quence.” 
But so does the one she marked. 


LGBGM TBKAK 


But so does the one she marked. 
FGHLM CDFGH 


63% of the errors were perceptual mistakes. We list here some examples: 
XIJKF 


SUBJECT PHK: “Because the other groups have the three middle letters in alphabetical se- 


ZDNEN 
SUBJECT KL]: “Because the other four groups have one letter repeated.” 


JKMNO 


YLMNF ZABCF 


FRLIC 


VPSPW 


SUBJECT JAH: “Because this group is the 
only one with a vowel.” 
But note the last group. 


16% (3 errors) were the result of 
wrongly formulated problem-task and 
have been already listed and discussed 
above under “Clear formulation of the 
problem.” 


2. The Efficacy of the Methods Used 

Following are the correlations between 
the methods used and the number of 
problems worked correctly. 

(a) Clear formulation of the problem. 
Clear verbal formulation correlated (bi- 
serial correlation) —.10 with problems 
worked correctly, so individual differ- 
ences in verbal formulation in this ex- 
periment do not seem to be related to 
successful solution. Apparently subjects 
understood the task in spite of inability 
to state the task clearly and correctly. 

(b) Preliminary survey of all aspects 
of presented material. All subjects used 
this factor, so no comparative evidence 
was available concerning its efficacy. 

(c) Analysis into major variables. The 
number of major variables reported 
correlated (product-moment correlation) 
+.51 (P.E. = .11) with problems worked 
correctly, so detection of major variables 
seems to be moderately correlated (posi- 
tively) with successful solution. 


B. THe Depucrion PROBLEM 


Following is the distribution of scores 
on the problem concerning the deaths of 


STVWX PQSTU 
Captain Watts and his son James. 
Students 
Correct cause for both deaths: 15 (60%) 
Correct cause for one death: 10 (40%) 
Correct cause for neither death: ° 


Given unlimited time, the majority, 
60%, solved the deaths of both Captain 
Watts and his son James. Of the minor- 
ity, 40%, some ascertained the correct 
cause of Captain Watts’ death, and some 
ascertained the correct cause of James’ 
death. 


1. The Methods of Attack Used 


All except one method (Analysis into 
major variables) were found. 

(a) Clear formulation of the problem. 
Apparently the nature of the task was 
self-evident, for all of the subjects stated 
the problem-task correctly. Two subjects 
seemed to have formulated the problem 
more vividly by extreme fixation of the 
answer-possibilities: these two subjects re- 
read the entire paragraph while keeping 
in mind the three possible causes (mur- 
der, accident, and suicide). 

(b) Preliminary survey of all aspects 
of the presented material. Table 3 shows 
the distribution of the number of times 
the whole clues-paragraph was read. 
Thus, about half of the subjects did not 
read through the entire paragraph even 
a second time. All of the subjects, how- 
ever, referred back to individual parts of 
the paragraph. 

(c) Locating a crucial aspect of the 


'%) 
%) 


No. of No. of 
Readings Subjects 

N=25 


‘Mean=1.8 readings 


problem. The question asking the sub- 
jects to list each item of information im- 
portant to solution involved every item 
except two: sentence (g) concerning a 
third man, and sentence (k) concerning 
James’ dislike of his father. Of the 9 
important points, Table 4 shows the dis- 


TABLE 4 
No. of Important No. of 
Points Reported Subjects 
3 
N=25 
Mean =6.7 points 


Stand. Dev. =1. 26 


tribution of the number of points re- 
ported by the subjects. As an average, 
the subjects reported more than 2% of the 
important items of information. 

(4) Application of past experience. 
Only g subjects reported such applica- 
tion, The remarks are quoted: 


SUBJECT MEM: “Yes, like the fact that a 
man can’t shoot himself in the back.” 

SUBJECT SEC: “Yes, I have built up a habit 
of considering every statement.” 

SUBJECT RMS: “Yes, the value of reviewing 
the facts by reading them again.” 


(e) Varied trials. On the question “Did 
you try to deliberately apply the possi- 
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bility of each of the three causes—mur- 
der, accident, suicide—to the death of 
Captain Watts—and then to the death of 
James—to determine whether the cause 
could have been murder, could have 
been accident, could have been suicide,” 
we found that 28% (7 subjects) answered 
“Yes” and 72% (18 subjects) answered 
“No.” Thus only about 4% of the sub- 
jects felt that they had tried to consider 
the possibility of each of the three causes 
for each man’s death, 

(f) Control. On the question’ “If you 
re-read the paragraph, did you single out 
each sentence to try to determine 
whether any of the various sentences 
made impossible one or two of the three 
possible causes,” we found that 44% 
(11 subjects) answered “Yes” and 56% 
(14 subjects) answered “No.” Thus a 
little less than half the subjects reported 
the use of this particular method of 
control. 

(g) Elimination of sources of error. 
The four questions testing for ability to 
detect and eliminate sources of error in- 
volved a total of 8 items in the para- 
graph. Table 5 shows the distribution of 
the number of points correctly reported 
by the subjects. Thus, of a maximum 
possible of 8 items, the subjects, as an 
average, detected half the items. 

(h) Visualization. 84% (21 subjects) 
reported visualization of the persons and 
events in the story, while 16% (4 sub- 
jects) reported absence of visualization. 

The general question (concerning use 
of other methods) brought forth remarks 
by only three subjects. The first subject, 
on noticing that she was to solve a “‘de- 
tective story,” said that she had a good 


* Here, as in the other questions probing for 
use of methods, the particular question asked 
is, of course, only one way of searching for 
methods, in this case for control of individual 
clues. 
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No. of Points No. of 
Reported Subjects 
7 


Mean =4.1 points 
Stand. Dev.=1.32 


imagination. Her solution would be 
satisfactory except for ignoring the gun- 
powder-burns on the back of James’ 
coat: “Captain Watts accidentally shot 
himself in the chest. The bullet went 
through his body and hit James, stand- 
ing behind him, in the back.” 

The remarks of the other two subjects 
(both of whom solved the problem cor- 
rectly) suggest, again, that subjects may 
not be aware of using methods and may 
not be aware of how they actually solve 
a problem: “Just reading and restating 
the points seemed to suggest solution,” 
and “Reading the material suggested 
various possible solutions which I 
checked 

The only method not discovered was 
“Analysis into major variables.” For this 
particular problem this method could 
refer to the three ways in which each 
man could have died (murder, accident, 
suicide); then the method would be 
synonymous with “Varied trials,”  re- 
ported on this problem. On the other 
hand, if the important clues are con- 
sidered as major variables, then this 
method would be synonymous with “Lo- 
cating a crucial aspect,” reported on this 
problem. 

The range of the total number of 
methods used per subject was from 3 to 


7, with the mean at 4.7 methods per 
subject. Of course this average conceals 
the qualitative differences in the use of 
a given method by different subjects and 
also the quantitative difference in the 
extent to which a method was used. 


2. The Efficacy of the Methods Used 


The following tables and bi-serial cor- 
relations show the relationship between 
the use of a method and the success or 
failure in solving the two deaths. 

(a) Clear formulation of the problem. 
All subjects seemed to formulate the 
problem clearly, so no measure of 
efficacy was possible. It might be noted 
that the two subjects who formulated 
the problem quite vividly (by fixating 
the three answer-possibilities while re- 
reading the paragraph) both solved the 
problem. 

(b) Preliminary survey of all aspects 
of the presented material..The number 
of times the subject read the clues-para- 
graph correlated +.22 with successful 
solution, so complete re-survey seems 
slightly related to successful solution. 

(c) Locating a crucial aspect of the 
problem. The number of important 
points detected and reported correlated 
+.39 (P.E. = .15) with successful solu- 
tion, so detection of this kind of crucial 
aspect seems slightly related to successful 
solution. 

(d) Application of past experience. 
Only g subjects reported the direct appli- 
cation of past experience (2 solved the 
problem), so no measure of the efficacy 
of past experience was feasible. 

(e) Varied trials. In interpreting the 
following percentages (in Tables 6, 7, 
and 8), it must be noted that 60% of 
the entire group solved the problem. 
Therefore the percentage of users of the 
method “Varied trials’’ must be compared 
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TABLE 6 


METHODS OF ATTACK ON 


REASONING PROBLEMS 


TABLE 8 


Solved Failed Failed 
(by 60% | (by 40% (by 60% | (by 40% 
of the of the of the of the 
subjects) | subjects) subjects) | subjects) 
7 subjects who tested 21 subjects who reported 
three possible causes 5 (71%) | 2(20%) visualization ; 12(57%) | 9 (43%) 
18 subjects not testing 4 subjects not reporting 
three possible causes | 10 ( 56%) | 8 (44%) visualization 3 (75%) | 1 (25%) 


with 60%, not with 50% (as would be 
the case if equal numbers solved and 
failed the problem). Of the 7 subjects who 
tested each of the three possible causes, 
71% solved the problem, 11% more than 
might be expected, so (our measure of) 
variation seems slightly related to success- 
ful solution. 


TABLE 7 
Solved Failed 
(by 60% | (by 40% 
of the of the 
subjects) | subjects) 
11 subjects who tested the 
effect of isolated items | 9 (82%) | 2 (18%) 
14 subjects not testing the 
effect of isolated items | 6 (43%) | 8(57%) 


(f) Control. Of the 11 subjects who 
isolated items and tested their effects, 
82% solved the problem, 22% more than 
might be expected, so this measure of 
control seems somewhat related to suc- 
cessful solution. 


(g) Elimination of sources of error. 


The number of items detected concern- 
ing sources of error correlated +.60 
(P.E. = .12) with successful solution, so 
our measure of detection and elimina- 
tion of sources of error seems to be mod- 
erately and positively correlated with 
successful solution. 

(h) Visualization. Of the 21 subjects 
who reported visualization of the per- 
sons and events in the story, 57% solved 


the problem, 3% less than might be ex- 
pected, so visualization does not seem 
related to successful solution. 

The total number of methods used 
correlated +.48 (P.E. =.14) with success- 
ful solution, and thus was moderately 
and positively correlated with success in 
this problem. 

Thus, four methods seem somewhat re- 
lated to successful solution of this par- 
ticular problem: 

Locating a crucial aspect 
Varied trials 

Control 

Elimination of sources of error 


C. THe GEOMETRICAL-FIGURE PROBLEM 


Table g shows the distribution of the 
number of trials required to solve the 
problem, and includes the 6 subjects who 
failed to solve the problem in the 14 
trials allowed. 


1. The Methods of Attack Used 


This tracing-puzzle is so constructed 
that, by starting at either one of the two 
end-points of the inner diagonal, solu- 
tion is easy. But starting at any other of 
the 14 remaining points makes solution 
impossible. Of course it is possible that 
a subject will happen to start at one of 
the two correct starting-points; one sub- 
ject did start thus and was surprised at 
his early solution, and his paper was 
excluded from our results since no infor- 
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Median =8 trials 


mation concerning work-methods was 
available. Of the nine methods of attack, 
only “Application of past experience” 
was not reported. 

(a) Clear formulation of the problem. 
All of the subjects seemed to have formu- 
lated the problem clearly; apparently the 
task in this puzzle is self-evident, from 
the nature of the instructions employed. 
Although many subjects started (and 
tended to continue starting) at the upper 
left-hand point, they had not assumed 
that the directions required that they 
start at this corner; possibly the deeply 
ingrained reading-habit of starting at up- 
per-left may underlie this phenomenon 
(Lindley, 10). One special aspect of the 
problem-task, however, was found to be 
unclearly formulated by a few subjects, 


who asked whether they might erase 
their last line drawn; the directions spe- 
cified “. . . do not erase or change what 
you have drawn. . .” 

(b) Preliminary survey of all aspects of 
the presented material. 38% of the sub- 
jects reported that they had studied the 
puzzle before beginning to draw. In one 
case a subject pondered for half a minute 
before beginning the first trial. On this 
particular problem, the time spent in 
preliminary survey was very short; sub- 
jects tended to gain familiarity with the 
problem through overt trial-and-error 
rather than through close inspection or 
implicit (imagined) trial-and-error. 

(c) Analysis into major variables. 
Since starting at either of the two correct 
starting-points makes solution rather 
easy, there is only one major variable: 
correct starting-point. However, since it 
is possible to go into a blind-alley even 
after starting correctly, the avoidance of 
blind-alleys may be considered as a 
minor variable. The subjects reporting 
the major variable all achieved the same 
general idea: starting at the center (“it 
seemed best to start at the center and 
work around’). However, the minor 
variable was not so specifically formu- 
lated. Although most of the subjects 
who reported it simply warned against 
blind-alleys, others were more specific 


Ficure 1. Geometrical-figure problem. 
Draw this figure, without going over any line already drawn and without taking the pencil off the 
paper. Fill in as many lines as you can. If you are unable to complete the figure, do not erase or 
change what you have drawn, but start over again on a new figure. Continue until you draw a 


complete figure successfully. 
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(‘Leave an open space near a partially 
drawn section to get back in later to com- 
plete the section.” And another: “Don’t 
start at any of the 4 outside corners.”). 
17% Of the subjects reported the major 
variable. 38% reported the minor vari- 
able (blind-alleys). And none reported 
both. 

(d) Locating a crucial aspect of the 
problem. Some subjects hit upon a “false 
crucial aspect”; they selected one point 
for starting and felt that solution de- 
pended only upon the care exercised 
after starting. Another false “crucial 
aspect” or “direction” consisted of de- 
tecting patterns: These subjects noticed 
the large octagon-pattern and tried to 
make it first, which necessitated starting 
at a point which was (unknown to the 
subject) detrimental to solution. Finally, 
some subjects conceived the idea of start- 
ing in the center, “to work around”; 
since two of the four center-points were 
correct starting-points, this was a partial 
localization of the problem, and the 
subjects soon solved the puzzle. 50% of 
the subjects reported some “crucial” as- 
pect (including false ones). 

(e) Application of past experience. Al- 
though there were a few subjects who 
had worked a similar kind of puzzle in 
the past, mone reported the applica- 
tion of any specific principle carried 
over from previous related experiences. 
Again, however, the criterion (verbaliza- 
tion) may have obscured minor aspects of 
carryover. Theoretically, the one great 
application that might have been made 
would be the notion of trying different 
Starting points. Inspection reveals, how- 
ever, that many “similar” puzzles are so 
constructed that, by starting at any point 
and exercising care, one can solve the 
puzzle; if this is true of the geometrical- 
figure puzzles previously tried by the 
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subjects, then no positive carryover of 
the major variable (correct starting 
point) in our puzzle could be expected. 
On the contrary, we should expect a dis- 
regard of the starting-point as a negative 
transfer to this problem. As reported 
below, under “Varied trials” and “Con- 
trol,” many of the subjects started con- 
secutive trials from the same point, thus 
confirming the possibility of negative 
transfer from previous puzzles in which 
starting-point may have been unim- 
portant. This finding also suggests that 
the efficacy of methods of attack may not 
be general but conditional, depending 
upon the degree to which any given 
method makes clear the crucial major 
variable or variables basic to the prob- 
lem at hand. A similar finding is reported 
under efficacy of the factors of “Varied 
trials” and “Control.” 

(f) Varied trials, (g) Control. As ex- 
perimentally defined, “control” (“varia- 
tion, isolation, repetition”) has been 
broken down into two factors for this 
problem: (f) Varied trials (“variation’’) 
and (g) Control (“isolation, repetition’’). 

Our only expedient measure of 
“Varied trials” was: the number of dif- 
ferent starting-points used, divided by 
the number of trials required for solu- 
tion. Thus, the highest possible variabil- 
ity would be. 100% for a subject who 
varied his starting-point on each new 
trial. The lowest possible variability 
would be 7% (really representing no 
variability), for a subject who tried only 
one starting-point in 14 trials (1 + 14). 
It should be noted, however, that this 
measure of variability refers to variabil- 
ity of starting-point and that there re- 
mains the complex variability displayed 
after starting. This latter variability, im- 
portant no doubt to the subject, did not 
permit measurement; thus we were un- 
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able to establish a general measure of 
variability. 

Our measure of “Control” was: Total 
number of trials in which the same start- 
ing-point was used two or more times 
consecutively, divided by the number of 
trials. Thus, a subject who started at one 
point for three trials, then at another 
point for two consecutive trials, and then 
at another point for, say, five successive 
trials, has demonstrated 100% control 
(3 + 2+5, divided by 10), in the sense 
that each new starting-point has been 
tried out for 2 or more trials before being 
abandoned. A subject who varied his 
starting-point on each new trial would 
demonstrate zero control (and, it should 
be noted, a variability of 100%). Thus, 
by definition for our limited means of 
measurement, high variability tended to 
go with low control (for this problem). 
However, since variation is an important 
aspect of control in the latter’s full mean- 
ing and use, we have here considered our 
two measures as two aspects of the same 
principal factor. 

The results showed “Variability” rang- 
ing from 14% (only 2 starting-points in 
14 trials) to 100% (different starting- 
point on each trial), with the mean at 
56%. “Control” ranged from 0% 
(changed starting-point on each trial) to 
100% (each new starting-point tried for 
2 or more consecutive trials), with the 
mean at 51%. Two interesting examples 
of introspections are quoted, as indicat- 
ing personal differences among subjects 
in carrying out empirically the sensed 
awareness of the efficacy of variation: 

SUBJECT ALG (Variability 36%; Control 
43%): On starting her sixth trial at a new point, 
said, “Variety is the spice of life, so I'll start 
here.” On starting her last possible trial (14th), 
she said, “Maybe if I start in the middle, some- 


thing might happen.” She started at a correct 
point and solved the puzzle. 


SUBJECT RMS (Variability 14%; Control 
93%): This subject began her second trial at a 
different point, but continued starting at this 
point right through the next 19 trials, un- 
successfully as regards the solution. While work. 
ing on her seventh trial, she said, “Maybe if 
I start at a different place, I’d make it.” But she 
started her eighth trial at the same point again. 
On starting her tenth trial at still the same 
point, she said again, “Maybe I don’t start at 
the right place.” But she began her eleventh trial 
at the same point again, as with the twelfth, 
thirteenth, and fourteenth (last). 


Thus, for our measures in this prob- 
lem “Control” seems to measure mainly 
persistence, with most of the variability 
partialled out and measured as “Varied 
trials.” 

(h) Elimination of sources of error. 
42% of the subjects reported the identi- 
fication and elimination of one source of 
error, mainly: blind-alleys (the minor 
variable). An unusual source of error was 
encountered, and met, by one subject 
who on her second trial unknowingly 
omitted the center diagonal, finished the 
rest of the figure, and thought that she 
had solved the puzzle until reminded (by 
the experimenter) of her omission. To 
meet this source of error, before begin- 
ning her next trial she marked light 
crosses in the five places where diagonals 
had to be drawn; she encountered no 
difficulty thereafter. This, of course, also 
represented ‘Locating a (minor) crucial 
aspect.” 

(i) Visualization. The maximum num- 
ber of possible-next-moves visualized by 
the subjects ranged from 2 to 7, with the 
mean at 4.4 moves. 

No other methods were revealed in the 
answers to the general question. 

The range of the total number of 
methods used per subject was from g to 
8, with the mean at 5.6 methods per sub- 
ject. Again, we recognize that the mean 
of 5.6 blankets the fact that a given 
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method differed qualitatively (and also 
in quantitative degree) from one subject 
to another on the same problem. 


2. The Efficacy of the Methods Used 


The following tables show the relation 
between the use of a method and the 
number of trials involved in solution. 
The number of trials are presented in 
a two-fold classification: Superior subjects 
(below the median number of trials) and 
Inferior subjects (above the median 
number of trials). These small numbers 
of cases derived from a study mainly 
qualitative in design do not permit rigor- 
ous statistical treatment, but inspection 
of the results grouped into the 2 cate- 
gories listed reveals general tendencies 
toward efficacy or non-efficacy of various 
methods. 

For 3 methods where a rank-difference 
correlation was feasible (although no 
measures of reliability were obtainable), 
the correlation is presented. 

(a) Clear formulation of the problem. 
All subjects seemed to formulate the 
problem clearly, so no measure of efficacy 
was possible. 

(b) Preliminary survey of all aspects of 
the presented material. Inspection reveals 
that among the subjects who reported pre- 
liminary survey there were about equal 
numbers of superior and inferior subjects. 


TABLE 1o 


Number of Trials 
Involved in Solution 


12 Supe- | 12 Infe- 
rior rior 
Subjects | Subjects 
(3 to 7 trials to 
trials) | “‘failed’’) 


Subjects making prelimi- 


nary survey (N =9) 5 4 
Subjects omitting prelimi- 
nary survey (N=r1s) 7 8 


And among those not reporting prelimin- 
ary survey, there were also about equal 
numbers of superior and inferior subjects. 
A preliminary survey of all aspects of the 
stimulus-material (in the minor degree 
to which it appeared.at all) did not seem 
helpful for solution of this particular 
problem. 

(c) Analysis into major variables. The 
majority (3 out of 4) of those reporting 


TABLE 11 


Number of Trials 
Involved in Solution 


12 12 
Superior | Inferior 
Subjects | Subjects 


Detected major variable 


N=4) 3 I 
Detected minor variable 

(N=9) 3 6 
Detected neither variable 

(N=11) 6 5 


the major variable were superior sub- 
jects. More inferior subjects reported the 
minor variable (unimportant in_ this 
problem), and about equal numbers of 
superior and inferior subjects reported 
neither variable. Awareness of the major 
variable seems to be related positively 
to successful solution. 

(d) Locating a crucial aspect of the 
problem. Of those who had an hypothe- 
sis which they considered crucial, there 
were more inferior subjects, And of those 
lacking such an hypothesis there were 


TABLE 12 


Number of Trials 
Involved in Solution 


12 Superior) 12 Inferior 
Subjects | Subjects 
Hypothesis (N = 12) 5 7 
No hypothesis (N = 12) 7 5 


ntrol 
ata Z 

this 

un- : 
vork. 
if 
t she 
gain. 
same 
rt at 
trial 
rob- 
ried 
of 
inor 
‘was 
ngly 
| the | 
1 (by 
2 
egin- 
light 
ynals 
1 no | 

also 
ucial 
4 

— : 

3 to 
- sub- 
mean ; 
yiven pe 


18 BENJAMIN BURACK 


more superior subjects. Mere presence of 
an hypothesis concerning a “crucial” 
aspect seems, if anything at all, nega- 
tively related to successful solution for 
this particular problem. It is probably a 
matter, not of having an hypothesis but 
of quality of the hypothesis, since a poor 
hypothesis is not merely indifferent but 
actually detrimental to the speed of 
solution on the geometrical-figure prob- 
lem. 

(e) Application of past experience. No 
subjects reported the direct application 
of specific principles which could be 
tabulated. 

(f) Varied trials. Variability correlated 
+.87 (P.E. = .07) with successful solu- 
tion, so varied trials seem to be highly 
related (positively) to successful solution, 
because our specific measure of variabil- 
ity (changed starting-point) eventually 
led to the correct starting-point. 

(g) Control. Control correlated —.61 
(P.E. = .11) with successful solution, so 
(our measure of) control seems to be 
moderately related (negatively) to suc- 
cessful solution, because isolation and 
repetition of same starting-point pre- 
vented the subject from trying the only 
two correct starting-points. 

(h) Elimination of sources of error. Of 
those reporting a source of error, there 
were more inferior subjects than superior 
ones. And of those not reporting a source 


TABLE 13 


Number of Trials 
Involved in Solution 


12 12 
Superior | Inferior 
Subjects | Subjects 


Detection of source of 
error (N=10) 6 
No detection of source of 
error (N=14) 6 


of error, there were more superior sub- 
jects than inferior ones. In stating that 
elimination of a source of error was not 
related positively to successful solution, 
it must be remembered that these errors 
(mainly blind-alleys) could not prevent 
failure based almost entirely on a single 
factor, namely: starting-point, a peculiar- 
ity of this particular problem. 

(i) Visualization. The number of vis- 
ualized possible-next-moves correlated 
+.37 (P.E. = .13) with successful solu- 
tion, so such visualization seems to be 
slightly related (positively) to successful 
solution. 

The total number of methods used 
correlated —.go (P.E. = .14) with suc- 
cessful solution, and seems slightly re- 
lated negatively, apparently because 
some methods hindered solution. So the 
mere use of more methods does not seem 
to guarantee solution. 

Thus, four methods show some rela- 
tionship to successful solution of this 
problem: (a) Analysis into major vari- 
ables, (b) Locating a crucial aspect, (c) 
Varied trials, and (d) Control. The na- 
ture of the relation (positive or negative) 
reveals that detection of the only im- 
portant variable (correct starting-point), 
by means of varied trials rather than by 
persistence at the same starting-point 
(“Control”), leads to rapid solution of 
this puzzle. In summary, although the 
various methods of attack may be help- 
ful in other problems, only “varied 
trials’ and “Analysis into major vari- 
ables” seem to be efficacious for solution 
of this problem, because the first leads to 
discovery of the second, and the second 
guarantees solution. The very construc 
tion of the figure, offering only 2 correct 
starting-points out of 16 possible starting- 
points, seems to render other methods 
useless. 
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N INTERPRETING the results of this ex- 
periment, certain limitations and 
sources of error must be borne in mind. 


1. The particular question or technique we 
used to determine use of a given method of 
attack was only one way of determining use of 
that method. 

2. The particular question or technique em- 
ployed by us often required a dichotomous 
answer, thus permitting only gross quantification 
of the use of some methods. 

3. There are probably other methods of attack 
besides the ones for which we searched. None 
was revealed in our investigation. 

4. Methods may be used but not reported. 
And, contrariwise reported use of a method does 
not guarantee that it was used by the subject. 
Our experimental technique revealed itself to 
be too dependent upon introspective report. 

5. In interpreting the absence of efficacy of 
certain methods of attack, it is important to 
distinguish between the methods reported by 
untrained individuals and the possibility of ap- 
plication of these methods by trained problem- 
solvers, 

6. Besides the various methods of attack used, 
other intellectual factors are of course partly 
basic to successful solution of these problems, 
factors not appearing as methods but contribut- 
ing nevertheless to solution. 

7. We used a highly select sample of subjects. 

8. The three problems which we used, al- 
though different in nature, were hardly rep- 
resentative of typical problems. 


In the following interpretations of the 
results of the experiment, Table 14 will 
be used for the first two questions, and 
Table 15 for the third. In Table 14 the 
first 3 columns show the average degree 
of use (based on a maximum possible use 
of 100%) of each method, by the group, 
for each of the three problems; the miss- 
ing entries indicate that no measure was 
obtainable for certain methods in certain 
problems. The fourth column shows the 
average degree of use for three problems, 
and the last column shows the average 
degree of use for only those problems 
in which a measure of the method was 
obtainable, 
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1. How did individuals differ in the 
methods they used to solve the problems? 

An obscuring factor in the presenta- 
tion of the comparison of individuals 
with regard to use or non-use of various 
methods lies in the fact that the indi- 
viduals differed, not so much in the kind 
of methods used, but rather in the ex- 
tent to which each used a particular 
method. The individual differences in 
extent of use of each method for each 
problem have been indicated in the 
body of this paper; in summary it can be 
stated that extent of use for any one 
method for any one problem appeared to 
be distributed normally, considering the 
limitations of measurement (gross meas- 
urement, dichotomous answers, etc.). If 
we credit an individual with use of a 
method, regardless of degree of use, the 
differences in the number of methods 
used on each problem only approximate 
a normal curve; since each of the three 
distributions represents, not a single vari- 
able, but rather a total use of any or 
all of g variables (methods), we would 
not necessarily expect normal distribu- 
tions. 

a. In the induction problem, where 
only 3 methods were used, every subject 
used either 2 or 3 methods, with the 
mean at 2.4 methods per subject. 

b. In the deduction problem, 
where 8 methods were used, subject used 
from 3 to 7 methods, with the mean at 
4-7 methods per subject. 

c. In the geometrical-figure prob- 
lem, where 8 methods were used, subject 
used from 3 to 8 methods, with the mean 
at 5.6 methods per subject. 

2. To what extent were the methods 
used in different problems? 
In Table 14, the fourth column of fig- 
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TABLE 14 


AVERAGE EXTENT oF UsE oF METHODS 


(All figures based on maximum possible or 100% use) 


Geometri- For For 
Method cal Three | Relevant 
Figure | Problems* | Problems* 


Clear formulation 


problem 40% 


100% 100% 80% 80% 
Preliminary survey 100% | 45%» | 38% 61% | 61% 
Analysis into major 70%" Same as ‘‘crucial 17% 290% 43-5% 
variables aspect” or 
“varied trials” 
Locating a crucial aspect | Not relevant? | 74%" | 50% | 41% | 62% 
Application of past o% 12% o% 4% 12% 


experience 


Varied trials Same as ‘“‘major 


variables”’? 


28% 42% 


Control Same as ‘‘major 


variables’? 


32% 47.5% 


Elimination of sources of 
error 


Not relevant? 


31% 46.5% 


Visualization Not relevant? 


33% 49-5% 


Total number of methods 3 
used on problem 


Mean-number of methods 
used per subject 


methods used by sub- 
jects on each problem 


Range of number of 2-3 | 


* Based on maximum of 8 major variables. 


° Based on maximum of 9 crucial aspects. 
4 Based on maximum of 8 sources of error. 


» Based on maximum of 4 readings (highest number by any subject). 


© Based on maximum of 29 possible visualized next-moves. . 
* These figures are intended as suggestive only, and have not been corrected for small differences in 


ures shows that some methods seem hardly 
to have been used at all. For example, 
“Application of past experience” seems 
to be almost completely absent (4%), and 
another 5, methods show use of only 28% 
to 33%. Inspection reveals, however, that 
“Application of past experience” was 
reported (by one or more subjects) on 
only one of the three problems; when 
the figure is based on the problem where 


the number of subjects in each of the three groups. 


the method was used, we see that 12% 
of the subjects reported its use. Further 
inspection reveals that the problem was 
a human relations situation (death ol 
two men), in which past experience 
would more likely be applicable, as com- 
pared with the two problems of a more 
perceptual nature. Even in these, how- 
ever, it is the author’s impression that 
finer techniques of investigation might 
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have revealed subtle use of the methods 
in question. 

For the 5 methods showing use of only 
28% to 33%, inspection reveals that each 
method was measurable on only two 
problems; when the figures are based on 
the two problems where used, the range 


becomes 42% to 49.5%. 

Why were measures unobtainable for 
certain methods on certain problems? 
Two reasons are suggested. 


a. For a given problem, certain presumably 
different methods appeared (to both the ex- 
perimenter and the subjects) to carry the same 
meaning. On the induction problem, for ex- 
ample, “Varied trials” and “Control” (two aspects 
of trial-and-error) consisted of applying generali- 
zations to the groups of letters; this method was 
measured as “Analysis into major variables.” On 
the deduction problem, “Analysis into major 
variables” could be considered as looking for 
clues, measured as “Locating a crucial aspect,” 
or as questioning each of the three possible 
causes (murder, accident, suicide) in relation to 
the death of each man, measured as “Varied 
trials.” It matters little whether the subject’s 
behavior is classified under one or the other of 
two headings; the important thing is that a 
distinction should be made between “methods” 
different in terminology only and methods dif- 
ferent in actual behavior of the subjects. 

b. A similar point is that, on a given prob- 
lem certain “methods” seem either meaningless 
or irrelevant. On the induction problem, for 
example, the experimenter was unaware of any 
“crucial aspects” among the groups of letters; 
if the common characteristics are crucial, then 
this method is identical with “Analysis into 
major variables.” On the same problem the 
experimenter was unaware of sources of error 
in the stimulus-material; and “Visualization” 
seemed to be irrelevant, in the sense that all 
the material was visual and seemed to require no 
additional visualization (imagery). The intro- 
spective reports confirmed the absence of such 
“methods.” 


We conclude, therefore, that although 
there is wide variation in the extent to 
which different methods are used, extent 
of use is partly a function of relevancy of 
certain methods to certain problems. In 
Table 14, for example, inspection reveals 


that only a few methods (3) are used on 
the induction problem, whereas most of 
the methods (8) are used on the other 
two problems; and the average use per 
subject follows the total number of 
methods used. Since the individuals do 
not change, we suggest that the number 
of methods used in different problem- 
situations depends upon the kind of 
problem involved: (a) some problems 
“permit” use of a given method (for ex- 
ample, application of past experience) 
while other problems do not; (b) in cer- 
tain situations a given “method of at- 
tack” becomes identical in meaning with 
a differently worded method of attack; 
and (c) in certain situations a given 
“method of attack” is a term rather than 
a form of human behavior. 

3. To what extent were the different 
methods efficacious? 

Table 15 summarizes the degree of ef- 
ficacy for each method on each problem. 

a. Clear formulation of the prob- 
lem showed no relationship to solution 
for one problem and was of unknown 
efficacy for the other two problems. It is 
suggested that the task may have been 
quite obvious in our problems, thereby 
permitting no individual differences in 
understanding of the requirements of 
the problem. 

b. Preliminary survey of all aspects 
of the presented material was of slight 
help in the deduction problem, of un- 
known efficacy in the induction problem, 
and of no efficacy in the geometrical- 
figure problem, It is suggested that suc- 
cess in the latter two problems requires 
considerable trial-and-error rather than 
global survey. 

c. Analysis into major variables was 
moderately helpful in the induction 
problem, slightly helpful in the geo- 
metrical-figure problem, and unmeasura- 
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TABLE 15 
EFFICACY OF METHODS oF ATTACK 


Correlations indicated when obtainable. Degree of relationship (‘‘Zero” or “slight’’) indicated 
where correlations could not be derived. Relationships not obtainable for: (a2) methods 
not measurable and (b) methods showing no substantial individual differences. 


Method 


Induction Problem 


Deduction Problem | Geometrical Figure 


Clear formulation of problem —.10 


Used by all: efficacy 


Used by all: efficacy 
not obtainable 


not obtainable 


Preliminary survey 
not obtainable 


Used by all: efficacy 


+.22 Zero 


Analysis into major variables +.51 Slightly positive 
(P.E. = .11) 
Locating a crucial aspect +.39 Slightly negative 
(P.E. = .15) 
Application of past experi- | Used by none Used by only three: | Used by none 


ence 


efficacy not obtain- 
able 


Varied trials Slightly positive + .87 
(P.E. = .07) 

Control Slightly positive —.61 
(P.E. = .11) 


Elimination of sources of + .60 Slightly negative 
error (P.E. = .12) 
Visualization Zero +.37 
(P.E. = .13) 
Total number of methods Number of methods +.48 — .30 
used insufficient to per- (P.E. =.14) (P.E. = .14) 
mit correlation 


ble in the deduction problem. It is sug- 
gested that this method tends to be help- 
ful because it may expose a variable 
fundamental to solution (along with un- 
important variables). 

d. Locating a crucial aspect was 
slightly helpful in the deduction prob- 
lem, slightly disadvantageous in the geo- 
metrical-figure problem, and unmeasura- 
ble in the induction problem. It is sug- 
gested that the potential efficacy of the 
search for crucial aspects is contingent 
upon the time or trials available to the 
problem-solver: with unlimited time (as 
in the deduction problem), the method 
tends to be helpful; with limited time 
or trials (as in the geometrical-figure 


problem), the method may obstruct solu- 
tion, especially if one hypothesis be per- 
severated (Maier’s “false direction”). 

e. Application of past experience 
was not reported by our subjects, so no 
measure of efficacy was obtainable. On 
the geometrical-figure problem, however, 
the work-sheets indicated a tendency to 
start at the same point (usually the up 
per-left) on consecutive trials, thus mak- 
ing solution impossiile. It is suggested 
that previous practice in tracing figures 
acts as negative transference, because 
most tracing-figures can be solved from 
any starting-point, so long as care is ex- 
ercised to avoid blind-alleys. 

f. Varied trials was slightly helpful 


me 
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in the deduction problem, paramount in 
the geometrical-figure problem, and un- 
measurable in the induction problem. 
Recognizing, however, that in the geo- 
metrical-figure problem our only meas- 
ure of variation was variation of starting 
point, and that correct starting-point is 
the only important factor for this partic- 
ular problem, it is suggested that the 
efficacy of variation is dependent upon 
its potentiality of exposing the major 
variable or crucial aspect of a problem. 

g. Control was slightly helpful in 
the deduction problem, detrimental in 
the geometrical-figure problem, and un- 
measurable in the induction problem. It 
is suggested that the efficacy of “isolation 
and repetition” of variables felt to be im- 
portant by the subject, or the efficacy of 
aspects felt to be crucial, is dependent 
upon the subject’s luck or skill in test- 
ing the important variable or aspect. 

h. Elimination of sources of error 
was moderately helpful in the deduction 
problem, slightly disadvantageous in the 
geometrical-figure problem, and unmeas- 


urable in the induction problem. It is 
suggested that the efficacy of this method 
is dependent upon its potentiality of ex- 
posing significant features of the situa- 
tion. 

i. Visualization showed a_ small 
positive correlation with successful solu- 
tion in the geometrical-figure problem, 
no effect in the deduction problem, and 
was unmeasurable in the induction prob- 
lem. Visualization could be of no help 
on the geometrical-figure problem unless 
a subject could visualize all 29 moves, 
because 2 of the 16 starting-points prac- 
tically guarantee solution, whereas 14 
starting-points make solution impossible 
with or without visualization. The small 
positive correlation in the geometrical- 
figure problem may indicate the typical 
positive correlation of abilities rather 
than a causal relationship. It is suggested 
that, as with several other methods al- 
ready discussed, the efficacy of visualiza- 
tion (and other imagery) is dependent 
upon the type of problem. 
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HE LITERATURE on reasoning reveals 
‘aac methods, techniques and 
auxiliary aids used by subjects during 
problem-solving. Nine of such known 
“methods of attack’’ were selected for 
investigation in this experiment. 

1. Clear formulation of the problem. 

2. Preliminary survey of all aspects of 
the presented material. 

g. Analysis into major variables. 

4. Locating a crucial aspect of the 
problem. 

5. Application of past experience. 

6. Varied trials. 

7. Control. 

8. Elimination of sources of error. 

g. Visualization. 

Three different problems were selected 
to be given to the subjects serving in this 
experiment. The induction problem was 
a short concept-formation test (identifica- 
tion of similarities and differences in 
letter-grouping series) devised by Pro- 
fessor Thurstone; 19 items were used. 
The deduction problem, chosen from 
one of Professor Thurstone’s reasoning 
tests, presented a paragraph of clues to 
the death of two men; the subject is to 
ascertain the cause of the death of each 
man. The general problem was a geo- 
metrical-figure problem of a maze-tracing 
variety. The problems were administered 
individually to a group of 25 under- 
graduate students, with an unlimited 
time-allowance. A number of specific 
questions were asked of the subjects dur- 
ing and after the work-period, and ob- 
jective records of the work-sheets were 
kept, designed to determine the use of 
the various methods of attack selected 
for investigation. 

Our problem was to determine the 
nature and efficacy of the methods of at- 
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tack used on different problems. The 
three main questions, and the results, 
were as follows. 

1. How did individuals differ in the 
methods they used to solve the problems? 

a. If we credit an individual with 
use of a method, disregarding degree of 
use, the number_of methods used was 
not distributed normally for either all 
three problems combined or for any one 
problem. It appears to us that normal 
distributions would not necessarily be 
expected, considering that each distribu- 
tion represents not a single variable or 
continuum, but rather a total use of any 
or all of nine variables (methods). 

b. In the induction problem, every 
subject used either two or three methods, 
with the mean at 2.4 methods. In the 
deduction problem, subjects used from 
3 to 7 methods, with the mean at 4.7 
methods. In the geometrical-figure prob- 
lem, subjects used from 3 to 8 methods, 
with the mean at 5.6 methods. 

c. Individual differences in degree 
of use of a particular method on a given 
problem appeared to be distributed 
normally, considering the limitations of 
measurement. 

2. To what extent were the methods 
used in different problems? 

There was wide variation in the extent 
to which different methods were used, 
certain methods being used on one prob- 
lem, and other methods on a different 
problem. Two methods were used on all 
three problems, six methods were used 
on two problems, and one method was 
used on only one of the three problems. 
Examination of the tasks required in the 
three problems suggests that, for a spe- 
cific problem: (a) certain presumably- 
different methods appeared to carry the 
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same meaning, and (b) certain so-called 
“methods” appeared to be meaningless 
or irrelevant. 

3. To what extent were the different 
methods efficacious? 

a. For a_ given problem some 
methods were efficacious, some were in- 
different, and some were detrimental to 
solution. The latter case seemed to occur 
whenever a particular method served to 
prevent or postpone discovery of the 
variable or aspect fundamental to solu- 
tion of the problem. 

b. Because no method was used on 
all three problems (except “Clear formu- 
lation,” used by almost everyone, and 
thus of unmeasurable efficacy), efficacy of 
a given method was demonstrable for 
only one or two of the three problems. 
For the latter case (two problems), two 
methods were efficacious on both prob- 
lems, two methods were efficacious on 
one problem and “indifferent” (zero cor- 
relation) on the other, and three methods 
were efficacious on one problem and 
“detrimental” (negative correlation) on 
the other. 

In interpreting the results, however, 
certain limitations and sources of error 
were recognized: 
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1. The particular question or technique used 
to determine use of a given method was only one 
way of determining use of that method. 

2. The particular question or technique em- 
ployed by us often required a dichotomous 
answer, thus permitting only gross quantifica- 
tion of the use of methods. 

g. There were probably other methods used 
which escaped our tools of search. 

4. Some of the nine methods may have been 
used but not reported and not demonstrated in 
the work-sheets. 

5. Various uncontrolled intellectual factors 
were also contributing to successful solution. 

6. We used a highly select sample of subjects. 

7. The three problems which we used, al- 
though different in nature, were hardly rep- 
resentative of typical problems, 


Four general conclusions are suggested 
as a result of this experiment. 

1. The extent of use of a particular 
method of attack varies with different 
problems and is dependent upon the 
kind of task involved. 

2. On a particular problem, certain 
presumably different methods may be 
identical. 

3. On a particular problem, certain 
so-called “methods” may be meaningless: 
mere terms having no meaningful refer- 
ence to possible behavior. 

4. The potential efficacy of a particu- 
lar method of attack depends upon the 
kind of problem involved. 
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